Skip to content

Conversation

@nailimixaM
Copy link
Collaborator

No description provided.

@nailimixaM
Copy link
Collaborator Author

@myshkov I've added an update to logging in run_lm_eval.py as it was broken before: the lm eval harness has its own logger which was overriding the one we had. Could you please check if my fix is sensible?

@nailimixaM nailimixaM changed the title Rename scripts and update GPU tests Rename scripts, fix logging, update GPU tests Feb 27, 2024
pip install -e .[finetune]
```

The following replicates the experiments in the paper (LoRA hyperparams valid for all Llama-2 and Phi-2 models):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you tried running this with the fixes that I added in my PR #101 yet? I expect better results than in the paper

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should do this, but it can come as a separate change, with another update to the readme if needed.

@nailimixaM nailimixaM merged commit 5273987 into main Mar 1, 2024
@nailimixaM nailimixaM deleted the max/tweaks branch March 1, 2024 15:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants